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An analysis of the uncertainty in mea- 
suring the root-mean-square, rms or R^, 
value of a periodic waveform which re- 
sults from the use of a finite record 
length is presented. Even though the re- 
sults of the analysis are somewhat as ex- 
pected, i.e., that the uncertainty is 
inversely proportional to the number of 
periods in the record, the explicit rela- 
tionship between the magnitude of the 
uncertainty and properties of the wave- 
form does not appear to be available in 
the literature. The paper first presents 
an introductory example in terms of the 
reasonably well known case of band- 



width limited Gaussian waveform to in- 
troduce definitions. Following this is an 
analysis of the periodic waveform using 
the same approach. It is shown that for 
a large number of periods, n, in the 
record length, the normalized three 
standard deviation of the rms value is 
given by 3/(87rn). 
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1. Introduction 



This paper presents a discussion of the uncer- 
tainty in measuring the root-mean-square, rms, 
value of a periodic waveform which results from 
the use of a finite record length. The analysis was 
motivated by seeking to understand the source of a 
random uncertainty component which was present 
in some measurements of the absolute arithmetic 
average, R^, deviation from a mean line of profiles 
of precision roughness specimens. The profiles of 
these specimens had an approximately triangular 
waveform with two wavelengths and amplitudes. 
For the longer wavelength specimens the random 
phasing of the waveform with respect to the 
recording interval proved to be a major source of 
uncertainty in the measurements. In this case the 
record length included 40 periods of the wave- 
form. Even though the results of the analysis are 
somewhat as expected, i.e., that the uncertainty is 



inversely proportional to the number of periods in 
the record, the explicit relationship between the 
magnitude of the uncertainty and properties of the 
waveform does not appear to be available in the 
literature. The discussion first presents an example 
in terms of the reasonably well known case of a 
bandwidth limited Gaussian waveform to intro- 
duce some definitions and relationships. Following 
this is an analysis of the periodic waveform which 
uses a similar approach. 



2. Bandwidth Limited Gaussian Waveform 

By definition the mean square value, q^, calcu- 
lated from a finite length L of the waveform j(ji:) is 
given by the equation: 
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J 



)djc. 



(1) 



For convenience and brevity in the following dis- 
cussion, the definitions listed below will be used 
[1]. 

Sample space=the set of points representing the 
possible outcomes of a measure- 
ment. 

(|)(A;)=a real number, called the random 
variable, which represents the out- 
come of a measurement indexed by 
k. 

j3((J))=lim Probability \i> < Mk) <i>+ Atbl 
A(|)^0 A(|) 

£{g'[(|)(^)]}=the expected value of any real sin- 
gle-valued continuous function 
g{^) of the random variable ^(k). 
It is given by: 






As an example, the mean square value of yix) is 
given by: 



E\y\x)]=V\\x)p(x)do,. 



E\y\x)\ will be defined as q^ which is that value 
approached by q^ as the record length L ap- 
proaches infinity. Also ^ is the limiting value for 
the mean ^^ as the number of samplings gets large. 
The variance of y{x) is defined by: 



var 



b}=E{(y--yf\= f" iy--yfp{x)dx. 

•^ —CO 



Similarly the variance in q^ is defined by: 

vs.T{q'}=E[iq'-efl 

For the special case when j(x) is a bandwidth lim- 
ited Gaussian waveform with zero mean, Bendat 
and Piersol [1] show that 



^^5^=^[l-e- 



-lUL' 



•-1 



where L * is the shift distance required for the auto- 
correlation function to drop by 63% of its zero 
shift value. If L > >L* the relation reduces to 



var{g^} ^ L * 
a L, 



The propagation of error formulae discussed by Ku 
[2] may be used to relate thejvariance of the root- 
mean-square value =rms=Vg^ to this variance of 
9^. Results given in table 1 of this reference show 
that if 



var q^ . 
— r4^-=e, then 



var rms 



f 



'4" 



Thus, the normalized three-standard-deviations 
limit, 3SD, in the root-mean-square values calcu- 
lated from randomly sampled lengths, L, of a 
Gaussian profile with a correlation length L* is 
given by: 



3SD limit of ^=x 



''1 



L ~^-^ L 



Whitehouse and Archard [3] report reasonable 
confirmation of this result for their test specimens 
which had approximately Gaussian profiles. The 
importance of this result is stated very clearly by 
Whitehouse and Archard [3]. "The variance of 
measured rms or R^ values for the roughness of a 
surface may be found easily if one knows the stan- 
dard deviation of a large number of such measure- 
ments made upon the same surface. Alternatively 
one may predict the variance from a knowledge of 
the correlation length of a typical profile of the test 
surface." The argument just given for the 3SD 
limit partially fulfills the "it can be shown" state- 
ment by Whitehouse and Archard. 



3. Periodic Waveforms 

Unfortunately these results do not apply for peri- 
odic waveforms such as that of many precision 
roughness specimens. However, the principles of 
calculation are still applicable. Consider the exam- 
ple of the sinusoidal waveform: 



y(x)=A sin(<ox-)-5). 



(2) 



The waveform is sampled for a length L with the 
phase angle 6 considered as the random variable of 
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the sample space. The angle d will be considered as 
having a uniform distribution over values from to 
lir, i.e.. 



^(0)=-—, O<0<27r and/?(0) = O, for all other 

ztt 



values of 
According to definitions in eqs (1) and (2): 



K 



T=Y I A^dTL\(ax + d)dx. 



Evaluation of the integral yields 



2_^[, sin 2(8 + 0) sin 20 



q - 



1- 



2u)L 



■+■ 



2b>L 



where d = U)L—2mr. The conditional variance of 
g^, given 8, is (noting that q^=A^/2): 



yariq'\8)=E[iq'-qy]=^ 



'A 



2TT 



sin 2(8 + 0) sin 20 A 



2 *-^ 2ft)Z. ' ^ 2(aL 2 



J 

Evaluation of the integral yields 



d0. 



var(^^|8)= 



^'*(l-cos28) 
16 (o'L^ 



Thus, if the record length happens to include an 
integral number of periods, var q^=0. But if we 
take the more likely case in which 8 has a distribu- 
tion of values like that of due either to variations 
in the measured wavelength, w"', or in the record 
length, L, the result integrated with respect to 6 is 
obtained as follows. 



var(^^)s 



2^Jo 



var(^^|8)d8 



1_ f" ^''(l-cos28) y^ 

~27rJ„ 160)^1.^ ''^• 



Substituting ft)Z/=8 + 2n7r followed by the intro- 
duction of dummy variables x and y reduces the 
integral to: 



•2(n + I)7r 



var(^^)s 



J /•2(n + 
•^ IniT 



X ^dx 



1 /~Kn + I)ir 

-- {co&y/y^)Ay. 



Solving these integrals yields: 



(var^^)s= 



J oj. (var q^\ 



16 47r'n(« + l) ^ 



1 



■l67r'«(n+l) 



where « is again defined by the equation 
d=oiL—2n7r. This result for (var q^)s does ac- 
count for the relationship between oiL and 8. Use 
of the same relationships between var q^ and 
var rms given earlier yields: 



(var rms)s 



1 



^ 647r'n(n + l)' 

An averaged normalized three-standard-deviation 
limit for variations of the rms values is then given 
by: 



\ 9 J ^■^Vnin+l) 
or for large n , 



(3) 



3Sd(^) = 



Sirn 



(4) 



Finally, if the record length L and measured wave- 
lengths, ft)"', are stable and such that 8 has a nar- 
row distribution about 7r/2 or 37r/2 the 
3SD(rms/^) could be as much as twice this average 
value. 



4. Comparison with Variations of 
Roughness Measurements 

For surface profiles obtained from roughness 
measurements, one would expect that the normal- 
ized BSD of a set of measured R^ values would be 
approximately equal to that computed for the Rq 
(rms) values since both quantities are similar mea- 
sures of the sampled profile's empirical probability 
density function. The measurements of i?a values 
which initiated this analysis should therefore be un- 
derstandable in terms of the results just derived. 

For the measurements, two types of specimens 
were used; one set had an R^ value of 3.2 jam and a 
wavelength such that n =40; the other set had an 
i?a value of 0.5 ;j,m and a wavelength such that 
n =250. Record lengths for the measurements were 
approximately 3.8 mm. Predicted uncertainties for 
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the variations of a measured value about the mean 
i?a are therefore: 



3SD3.2^m=0-3% of meani?a 



and 



3SDo. 



5 fim" 



= 0.05% of meani?a 



if one assumes the averaged three standard devia- 
tions limit. The maximum values for the analytical 
uncertainties are 0.6 and 0.1% of the mean R^ val- 
ues for the 3.2 and 0.5 jum specimens, respectively. 
In a series of 80 sets of three R^ measurements, 
the uncertainty (3 standard deviations) of these 
triplicate measurements with respect to their aver- 
age values was: 

3SD3 2= 1.0% of mean i?„ 



and 



3SDo.5 = 0.7% of mean R^. 

The intent of this comparison between the analyti- 
cal and experimental values is not that of justifying 
the theoretical analysis. However, in terms of un- 
derstanding the experimental variations the agree- 
ment is sufficient to confirm that, for the longer 
wavelength specimen, a major source of uncer- 
tainty for the roughness measurements results from 
the finite sampling length. 

The imperfect waveforms of the precision 
roughness specimens are the most likely sources of 
the residual uncertainty. As illustrated in figure 1 
the specimen waveforms have distortions which 
are produced by either an additive random func- 
tion together with phase modulation or by the 




:1.06|JLin 



1a. Waveform of 3.2 |J>.in R, Specimen 



0.82 (imj 





= 25.S |xm 



1 b. Waveform of 0.5 |Jim Ra Specimen 



Figure 1. Waveforms of roughness specimens which were used 
for statistical studies. 



combination of random amplitude and phase modu- 
lation. The effect of an additive random function is 
the only one which can be readily analyzed. For 
this case the rms value of the sum of two uncorre- 
cted waveforms adds in a rms manner. Assume 
that the waveforms can be represented by the sum 
of a random component, with an rms value of ^r 
and a correlation length of L*, and a periodic com- 
ponent, with an rms value of q^ and angular fre- 
quency ft). Then the use of propagation of error 
formulae derived by Ku [2] yields: 



3SD(f)=..5[2.^ 



+ - 



16«V 
where n and L are as defined earlier and 





Estimates of ql_ and L * from the calculation of au- 
tocorrelation functions of the waveforms for the 
0.5ju.m—i?a specimen are: L* = 0.05L and^R=0.01 
ql. Effects of random amplitude and phase modula- 
tion are not accounted for in these estimates. With 
these values of ^r and L * the dominant source of 
uncertainty for the waveform sampled for 250 peri- 
ods is the random additive component which in- 
creases the uncertainty limits to 0.3% of the mean 
value. Approximately the same values for L* and 
ql_ were obtained from studies of the 3.17jtim— i?a 
specimen. Since 9r=2.8x10~'* ql, in this instance, 
the uncertainty produced by the random compo- 
nent is insignificant for measurements on this speci- 
men. 



5. Conclusion 

The uncertainty in measuring the root-mean- 
square value of a finite record length of a periodic 
waveform has been obtained and is given in eqs (3) 
and (4). The theoretical results were compared 
with data obtained from surface profile measure- 
ments of precision roughness specimens. However, 
eqs (3) and (4) are quite general and will apply to 
rms measurements of the amplitude of periodic 
waveforms arising from other areas. 

During customary announcements of this paper 
to NIST staff, an analysis of the errors of measure- 
ment due to variations in sampling interval length, 
(complimentary to that presented here), was 
brought to the author's attention. The effects of 



370 



Volume 94, Number 5, November-December 1989 

Journal of Research of the National Institute of Standards and Technology 

adjusting the sample interval length relative to an 
integral number of cycles of the test waveform are 
determined and applied to measurements of electri- 
cal power with a wattmeter [4], 
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